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Abstract 

The GENERIC theory provides a framework for the description of non- 
equihbrium phenomena in isolated systems beyond local thermal equilibrium 
and beyond linear non-equilibrium (i.e., linear relations between thermody- 
namic forces and currents). The framework is applied to some simple and 
general systems: reactions with detailed balance and Fokker-Planck (FP) 
equation. It is shown how to apply the theory to a combination of system and 
reservoir in the case of the FP equation. 

1 Introduction 

A statistical mechanics definition of entropy for systems out of equilibrium remains 
an open problem despite the efforts devoted to obtain it during many decades, since 
the days of Boltzmann and Gibbs. The most common approach, that works in sev- 
eral cases, is a generalization of the Gibbs definition of entropy from equilibrium to 
non equilibrium systems: Sq = J pit) In p{t) d"'x, where the time dependent prob- 
ability density p{t) is defined in the ra-dimensional phase space of micro variables 
(x), but the same form is also used for macroscopic variables. There are problems 
with this generalization. It is well kn own that Sq remains constant for any Hamil- 



tonian system (see, e.g.. IUffinkll2006l . Sect. 5.3) , even for time-dependen t ense mbles 



describing isolated systems not in equilibrium. iGoldstein and Lebowitzl ( l2004l ) con- 
sider that, for non equilibrium systems, the Boltzmann's definition of entropy is 
more appropriate: Sb = A;b1iiF, where ks is Boltzmann's constant and F is the 
number of micro states con sistent with a gi ven macro state. Regarding the cases 



where Sq remains constant, iGoldsteinI (120021 ) says 



It is frequently asked how this can be compatible with the Second Law. 
The answer is very simple. The Second Law is concerned with the ther- 
modynamic entropy, and this is given by Boltzmann's entropy, not by 
the Gibbs entropy. 

But Boltzmann's entropy is not free of problems. There is some vagueness in its 
definition. In many cases, it is not clear how to evaluate the number of micro states 
consistent with a given macro state. 

For example, let us consider a linear optical cavity pumped with an external field. 
If the evolution is described in terms of the number of photons, it is not difficult to 
obtain the entropy using Boltzmann's definition. Furthermore, if N is the number of 
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photons and M is the number of micro states for one photon, it can be shown that, 
when maximizing Sb-, one gets Bose-Einstein distribution for ~ M, Boltzmann 
distribution for N <^ M and the Rayleigh- Jeans hmit for ^ M. The situation 
is more difficult when the description is in terms of the number of photons and the 
phase (including, for example, the effects of detuning or diffraction), because it is 
not clear how the number of micro states F depends on the phase. 

Because of the difficulties and problems of using the statistical mechanics defi- 
nitions of entropy in non equilibrium systems, I try to adopt a different approach 
her e. The GENERI C framework, developed in Beyond Equilibrium Thermodynam- 



ics. 



Ottingerl (120051 ). can be used to obtain a form of the entropy function or func- 
tional, without considering any a priori definition of entropy from first principles. 
The general time-evolution equation for beyond equilibrium systems, or GENERIC, 
takes a very compact and simple form: 

where X is a set of variables that describe a closed system, E{X) and S{X) are the 
total energy and entropy, and L[X) and M{X) are the Poisson and friction matrices 
that represent the reversible and irreversible contributions generated by E{X) and 
S{X) respectively. Operator 6/6X is a partial or functional derivative depending on 
E{X) and S{X) being functions or functionals of X. The Poisson matrix L{X) must 
be antisymmetric and the friction matrix M{X) must be symmetric and positive 
semidefinite. Furthermore, they should satisfy the degeneracy requirements 

HX)-'-^ = 0. (2) 
MW-^ = 0. (3) 

These conditions guarantee energy conservation and entropy increase: 

dE ^ dS 

— = and — > 0. 4 

dt dt - ^ ' 

The conditions on L and M can be transformed into conditions on the derivatives 
of the entropy, and can be used to determine it without assuming a specific form 
from the beginning. Here, I illustrate this possibility with some examples of systems 
that, in principle, are not isolated. It is then necessary to include a reservoir in 
the description, so that the combination of system and reservoir is isolated, and 
E{X) and S{X) represent the energy and entropy of this combination. I use some 
simplifying assumptions in order to keep the description of the combination as simple 
as possible; they are explained in Sect. [2J 
The systems analyzed are: 

• Drift and diffusion system described by a Fokker-Planck equation (Sect. [3]). 
One particularly interesting case is the Kramers equation, because an always 
increasing entropy can be obtained for a system that does not necessarily 
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satisfy the local thermal equilibrium assumption. I show that the conditions 
on the friction and Poisson matrices can be used to determine that the entropy 
should belong to a given class of functions. 

• General reaction system with detailed balance (Sect. H]). This case can be 
combined with the previous one to get the GENERIC structure for reaction- 
diffusion systems. 

• Linear cavity with dispersion and diffraction effects (Sect. [5]). Lyapunov func- 
tionals for this kind of syst em s, even with nonlinea r terms, are well known 



see, e.g., iMayol et a/lll999l or iMontagne et a/lll996l ). The derivation of the 



GENERIC structure is presented as an example of the procedure described 
here for non-isolated systems. 



The first two examples were already studied by iMielke using the Wasser- 

stein metric, where a diffusion equation without drift term was used instead of the 
Fokker-Planck equation. The intention here is to present a different perspective on 
the same problems. 

In Sect. [6]I make some comments on the rule used to determine reversible and 
irreversible terms. 



2 Simplifying assumptions 

The starting point is a set of equations that determine the evolution of a system 
in contact with a reservoir. Variables n represent the state of the system. They 
can be fields depending on the space variable x of dimension d. The complete 
description of system and reservoir require additional variables. Since the initial set 
n is restricted to the system, I assume that the total energy density e is not included 
in n. More additional variables may be required to obtain a GENERIC equation; 
I call them a, and they are still to be specified. The state variables that describe 
the combination of system and reservoir are X = (n, e, a). The total entropy and 
energy are S = J s d'^x and E = J e d'^x. The main simplifying assumption is that 
the entropy density s is a function only of n and a, 

s = s(n, a). (5) 

In other words, the properties of the reservoir are chosen in such a way that the 
total entropy density is independent of the total energy density. In general, entropy 
is a function of a set of extensive variables that include the internal energy U, 
i.e., S = S{U,£), where £ represents the rest of extensive variables; and, if the 
temperature T is defined, we have that |^ = 1/T. I am assuming that there is an 
equation of state that relates the internal energy with the rest of extensive variables: 
U = U{S), so that S can be taken as a function of £ only. The total energy E is an 
independent variable (i.e., knowledge of £ and U is not enough to determine E). 
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SS dn \ 5E , , 

and — = 1 . (6) 




Then, 



SX \ j 5X 

\ da / 

The available information for the dynamics are the system's evolution equations 

where R is a set of functions that may depend also on space derivatives of n. From 
energy conservation, we have that / 1| d'^x = 0.1 also assume that any energy flux 
in the system is compensated by an opposite energy flux in the reservoir, so that 

What remains to be sp ecified is a and its evolution. This is a central point of this 



paper. As lOttingerl (12005L p. 11) says: "A crucial part of GENERIC modeling is the 
choice of the state variables X or, in other words, the definition of a suitable system 
to describe certain phenomena of interest." The criteria are to keep the description 
as simple as possible and not to add arbitrary information through the evolution 
of a. In some cases it is not necessary to add any variable a, and it is enough to 
add only the energy density e. Some appropriate choices of a, that allow to write 
GENERIC equations, are proposed in the next sections. 



3 The Fokker-Planck equation 

The Fokker-Planck equation is 

f) If) 

where J is the particle current, A is the drift vector and B is the (positive semidef- 
inite) diffusion matrix. The space vector x may include odd variables under time 
reversal (like momenta). The system evolves irreversibly to the equilibrium solution 
TT-e- It is convenient to separate the current in their reversible and irreversible parts 
taking into account that, in equilibrium, the irreversible part should be zero: 

He dn/ne 



with V = A — • (Brie). According to the rule mentioned in Sect. |6] for de- 



termining reversible and irreversible terms, it is necessary to assume that there are 
physical arguments to state that v — v when t ^ —t 



ry 

B 



^If X includes odd variables under time reversal, when t ^ —t the space variables change as 
X ^ T-x, where T is a diagonal matrix with numbers 1 for even variables and —1 for odd variables 
under time reversal. In this case, v — > —T ■ v. 
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I propose the following set of variable to describe the combination of system and 
reservoir: X = (n, e,ne). So, the derivatives of entropy and energy are 



6S_ _ 
SX ~ 

The evolution equation is 



/ ds 
' dn 



I ds 



and 



5E 




1 









dt 



(12) 



V 



3.1 Friction matrix 

The friction matrix is 



M(x,x') 



/ Mn(x,x') 

V 



(13) 



it satisfies the degeneracy condition (|3]) and it should also satisfy 

5S 



dX_ 
'dt 



M(x, x') 



5X 



ax V 2 ax J 





V 







(14) 



The notation of lOttingerl (120051 ) was used, where the big dot • means matrix mul- 
tiplication and integration in the continuous index x', and ^ is evaluated in x'. 
Then 



/ Mn(x,x'; 



ds 
dn 



d_ I dn/rie 
' 2 ' 9x 



or, more generally. 



/ Mn(x,x') 



dn 



(15) 



(16) 



where / is a function of n/ne- The solution for Mii(x, x') is 

/(x') d 



Mn(x,x') 



ds 


(9x' 


dn 


x' 



5 fx') • ,^^(^~^') 



(17) 



2/'(x') ' ax' 

where /(x') = /[n(x')/ne(x')] and ^ ^ means that this derivative is evaluated 
in (n(x'), ne(x')). It can be shown that (fTTIl is solution by replacing it in ( !T6|) . 
integrating twice by parts and neglecting boundary terms. 
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Mii(x, x') must be positive semidefinite, i.e., it should be possible to write it 

Mn(x,x') = J rfVV(x,x") • V(x',x"), (18) 

where V(x, x") is a vector of, in principle, arbitrary dimension. To get this form, 
we rewrite f ll7p as 



Mn(x, x') = J d'^x" 5(x' - x")Mn(x, x") 



d_ 



o(x — X 



ds 




dn 


x' 



2/'(x") 



The only factor that contains x is ^^^^tt^, and it should be included in V(x, x"). 
This means that there should be also a factor for V(x', x"). Taking 

ds 



dn 



-f 



(20) 



we obtain the desired form with 

V(x,x") = 



rir-. X' 



C 



95(x - x") 



\ 2/'(x") dx." 



(21) 



where I have used the fact that B = C'^ ■ C is positive semidefinite. From the square 
root in ( 12T!) we have that / should satisfy the condition /' > 0. 

In summary, from the conditions for the friction matrix we obtained that |^ is 
equal to minus any function of n/ue with positive derivative. So, the entropy density 
is 

sin.rie) = -neF{n/ne) + Fe{ne), (22) 

where F' = f , F" > 0, and Fe is a function of Ue- 

Using the maximum condition we have that |^ = —F'(l) = 0. Let us note 

that, if the constrai nt f njx) d'^x = const, is considered, an arbitrary constant may 
be added to F' fsee I6ttingerll2005l . p. 454). 



3.2 Poisson matrix 

The Poisson matrix is 



fx,x') 



-r2(x)v(x) • 



V 







dx 



n X 







rirAX V X' 



dS 

as 

' cht.' 



-Up X V X 







dx 



(23) 



^The condition for a matrix M to be positive semidefinite is that it can be written as 
M = C ■ C'^ . The generahzation of this condition to continuous indexes is Af(x, x') = 
/ (i'^x"y(x,x")F^(x",x') = / d''a;"F(x,x")F(x',x"). In (HH]), V was replaced by vector V using 
the fact that the sum of positive semidefinite matrices is also positive semidefinite. 
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where 5 = 5(x — x'). It is easy to see that the reversible part of the dynamics is 
given by 

'dt 



T( '\ 



I . (24) 
V 



From the degeneracy condition ([2]) we obtain 

d ds d ds ^ , ^, 

■ — — + neV ■ — -— = 0. (25) 
ax on ax oue 

From (El]) we have that ^ = -F' and |^ = -F + ^^F' + F'^, and, replacing in (|25D, 
we get Fg" = 0. Then, Feijie) = ciUe + C2; constant C2 can be ignored (it represents 
a shift in the origin of the entropy) and the term ciUg can be absorbed into F, so 
that 

s = —neF{n/ne) (26) 

with -F'(l) = and F"{n/ne) > 0. Eq. (12 6 p defines a class of functions for the 
entropy. The function s = —nln{n/ne) + n is one member of the class. 
All members of the class have a similar behavior close to equilibrium 

. ^ _ (27) 

where it was assumed that -F(l) = 0, and F"{1) was absorbed in the units of s. 

We got a GENERIC structure for the Fokker-Planck equation, with matrices M 
and L that satisfy all required conditions. The conditions were used to show that 
the entropy should belong to a determined class of functions. 



4 Reactions 

Let us consider a homogeneous system of m reacting species, with densities n = 
(77,1, ...,nm). There are r possible reactions, with stoichiometric coefficients ocj {(3^) 
for the forward (backward) reaction number j. The reaction rate is 

Jj = fc+j-n"^ - k^ju^^ for j = 1, r (28) 

where and kj^j and k_j are the forward and backward reaction 

constants. 

The evolution equation for the densities is 
The reaction terms are given by 

R = z/ • J (30) 

where i/ is a m x r matrix of stoichiometric coefficients, with components z/^- = 
Pij — Cdj- I assume that detailed balance is satisfied, i.e., there is a stationary 
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solution He = (riei, nem) for which J(ne) = 0. Using this condition, we can 
rewrite the reaction rates as 



-^j = '^i K ' ^^^^ 

with Cj = /c+j-n"^ = k-jiie^ > 0. 

For a non-homogeneous system with diffusion processes, we have to use variables 
X = (n, e, He) and generalize the result of the previous section to a multicomponent 
system. For a homogeneous system, it is possible to derive the GENERIC structure 
without additional variables, i.e., we can use X = (n, e) for the description of system 
and reservoir. 

The evolution is irreversible and there are not reversible terms in fl29|) . since if 
time is inverted {t —t) none of the terms in the right hand side changes sign. 
This means that the Poisson matrix L is equal to 0. The derivatives of entropy and 
energy are 

dE ( 0\ 




1 



(32) 



The friction matrix is 

/ 5:5: n \ 

(33) 

where a = R ■ |^ and RR is a dyadic tensor with components [RR]ij = RiRj. It is 
easy to see that 

f = M.|^=fM. (34) 

dt dX \ J' ^ ^ 

and that a is equal to the entropy production rate It is also easy to see that M 
satisfies the degeneracy condition ([3]). Matrix RR is positive semidefinite; it can be 
written as RR = C ■ C'^ , where C = Rl, with 1 being a m-dimensional unit vector. 
Therefore, the only condition to have M positive semidefinite is cr > 0. 
It is known that 

S = Yl[ni-ni ln(ni/ Uei)] (35) 



satisfies cr > for a reaction system with detailed balance (jMielkdl2010l ). This can 
be proved as follows: 



cr 




{/3ji - aji) In — 



(36) 

where i = l...m, j = l...r, aj = n"j/n"^ and bj = n^^/nf-'. 
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5 Linear cavity with dispersion and diffraction 



In this section I analyze a single-mode cavity with a linearly polarized electromag- 
netic field. Non linear effects are neglected. The equation for the complex amplitude 
A is 

r)A ff A 

^ = An - (7 + iO)A +{a + (37) 
at o:k^ 

where A^^ is the pump field, 7 > is the cavity decay rate, 9 is the cavity detuning, 

a > represents dispersion, (3 is diffraction, and ^ is the transverse Laplacian (in 

the plane perpendicular to light propagation). 

The change of variables a = A — As is proposed, where Ag is a stationary solution 

{As and may depend on space). The equation for a is 



da , , ■n\9'^o. 

— = -(7 + iO)a + {a + «/3)tc:^. 



dt 



(3J 



The complex variable a in terms of its real an imaginary parts is a = ai + 202- The 
real part ai is even under time inversion, while the imaginary part 02 is odd. Under 
a time inversion, the terms with 6 and /3 remain unchanged, they are reversible. The 
terms with 7 and a change sign when time is inverted, they are irreversible. 

The variables proposed to describe the problem are X = (ai, 02, e). The deriva- 
tives of entropy and energy are 



5S_ 
SX 



/ 9s 
' dai 

ds 

da2 

V 



, SE 




(39) 



The evolution equations are 



ax 

'dt 



-7a2 - ea^ + + 

V 



(40) 



The reversible part of the dynamics is given by 



dX 
It 



T( '\ 



(41) 



with 






-002(5 

]da2 dS 



V OX ax ^ ox ox 



where, as before, 6 = (5(x — x'). 






eaiS 

dai as 



as 







From the degeneracy condition ([2]) we obtain 



(42) 



- Oa2T. h p 



'dai 



d ds ^ ds „dai d ds , 
+ Oai- — = 0. (43) 



9x c^x 9a 1 



dai 



dx dx da2 
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A solution for this equation is s = Ci(a^ + O2) +'^2- Constant C2 can be ignored, and, 
as we will see in the next paragraphs, C\ must be negative in order to have a positive 
semidefinite friction matrix. I use following expression for the entropy density: 



The irreversible part of the dynamics is given by 



dX 



M(x, x') 



with 



sx 




and the friction matrix M is given by 
M(x, x') 



V 















(44) 



(45) 



(46) 



(47) 



The matrix M(x, x') is symmetric, positive semidefinite, and satisfies the degeneracy 
condition (|3l). 



6 Comments on the rule to determine reversible 
and irreversible terms 

The rule generally used to determine if an equation is reversible or irreversible is 
based on the time reversed (t — )■ —t) equation. If the same equation is obtained, 
then it is reversible, if a minus sign appears, it is irreversible. Hamilton equations 
of classical dynamics are reversible; the Schrodinger equation is also reversible (for 
complex quantities, time inversion also implies complex conjugation). The diffusion 
equation is irreversible. An equation can have a mixture of reversible and irreversible 
terms, those that preserve sign under time inversion are reversible, and those that 
change sign are irreversible. 

This is the rule used in the previous examples, and it generally works, but not 
always. There are cases where the irreversible behavior is manifested not in the 
differential equations but in the initial conditions, and the rule refers only to differ- 
ential equations. The following simple example is useful to illustrate this problem. 
Let us consider the Newton's cooling equation 

dx , , 

— = -ax, (48) 
dt ' ^ ^ 

where x is the temperature difference between two bodies and a > is related to 
heat conductivity. The equation is obviously irreversible, and entropy is produced 
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due to the heat flux from one body to the other. Now let us consider the equivalent 
system 

dx 

? = (49) 
dt ^ ' 

where y is defined as odd under time reversal, and it has initial condition uq = 
1. According to the rule, the system is now reversible, and it has zero entropy 
production. This is wrong; the rule does not work in this case. The irreversibility 
is still there, in the allowed values for the initial condition of y. When we invert 
time, we get exactly the same differential equations, but, since y is odd under time 
reversal, the initial condition is now yo = —1, and this value violates the second law 
of thermodynamics. 

The argument is very similar to the one used by Bolt zmann in a discu ssion with 



Ostwald regarding the irreversibility paradox (cited in iLebowitzl Il993l . replies p. 
115): 

From the fact that the differential equations of mechanics are left un- 
changed by reversing the sign of time without anything else, Herr Ost- 
wald concludes that the mechanical view of the world cannot explain why 
natural processes run preferentially in a definite direction. But such a 
view appears to me to overlook that mechanical events are determined 
not only by differential equations, but also by initial conditions. 

In summary, I think that the rule to distinguish reversible and irreversible terms 
should be revised and take into account, in some way, the initial conditions. 



7 Final remarks 

I presented the GENERIC equation for three examples (Fokker- Planck equation, 
reactions and linear cavity) and, using the conditions on the Poisson and friction 
matrices, obtained an expression for the entropy in each case. 

The first difficulty present in the examples is that they consist in non-isolated 
systems, and the GENERIC equation (in its basic formulation) applies to isolated 
systems. The approach proposed here is to extend the description to system and 
reservoir including additional variables, so that the combination is isolated. It is 
explained, in Sect. how to do this extension using some simplifying assumptions. 
The main assumptions are that the entropy density is independent of the energy 
density e, and that the energy density does not change with time (the energy density 
of the system may change, but not the total one). Besides e, there are the additional 
variables a to be specified for each system. For the Fokker-Planck equation, the 
equilibrium density Ue was used as the additional variable, with ^ ~ (^''^e) = 
0. The inclusion of rif, in the description makes it possible to satisfy the degeneracy 
condition f l25|) of the Poisson matrix (^^. For the homogeneous reaction system 
and the linear cavity it was enough to add only the energy density. 
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The method proposed is, of course, not systematic, since the election of a depends 
on the specific system. But the guidehnes illustrated with these examples may be 
relevant to a wide class of systems. 
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